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@ Improved Interactive Medical-Imaging System 

Complex surgery can be simulated collaboratively at multiple locations in real time. 

Ames Research Center, Moffett Field, California 


An improved computational-simulation 
system for interactive medical imaging 
has been invented. The system displays 
high-resolution, three-dimensional-ap- 
pearing images of anatomical objects 
based on data acquired by such tech- 
niques as computed tomography (CT) 
and magnetic-resonance imaging (MRI). 
The system enables users to manipulate 
the data to obtain a variety of views — for 
example, to display cross sections in spec- 
ified planes or to rotate images about 
specified axes. Relative to prior such sys- 
tems, this system offers enhanced capabil- 
ities for synthesizing images of surgical 
cuts and for collaboration by users at mul- 
tiple, remote computing sites. 

The system (see figure) includes a 
database, a reconstruction unit, and a vir- 
tual collaborative clinic (VCC) . The data- 
base contains data from an MRI, CT, or 
other scan. Within minutes of the scan, 
the reconstruction unit can process the 
data into high-resolution, stereoscopic 
images. The reconstruction unit includes 


a subunit that generates polygonal 
meshes to represent surfaces of anatomi- 
cal objects. Whereas prior medical-imag- 
ing systems generated such meshes by 
means of an algorithm known in the art 
as the marching-cubes algorithm, this sys- 
tem utilizes an improved algorithm that 
makes it possible to reduce the computa- 
tional burden of rendering surfaces at 
high resolution. In particular, the im- 
proved algorithm makes it possible to re- 
duce the number of polygons drastically 
(by as much as 98 percent in some cases) 
without loss of topographical features, 
and without introducing spurious tears 
and holes, which occur in marching- 
cubes applications. 

The reconstruction unit includes a vi- 
sualization module, which processes data 
from the mesh generator and the data- 
base into images for display. An anima- 
tion module makes it possible to gener- 
ate sequences of images that show how 
anatomical objects change over time. A 
user-input module enables a user to ma- 


nipulate images and control other func- 
tions by means of a mouse, trackball, 
touchpad, or other standard input de- 
vice. Yet another module is the cyber- 
scalpel, which, as its name suggests, en- 
ables the system to simulate cutting of an 
anatomical object displayed via the visu- 
alization module. 

The VCC is an extension of the recon- 
struction unit. The VCC can include 
counterpart components that reside on 
separate computers at multiple remote lo- 
cations, enabling users at those locations 
to interact with the same simulated 
anatomical objects in real time. The data 
structure of the system provides for shar- 
ing, among the geographically dispersed 
computers, of a number of variables and 
of computational models that represent 
anatomical objects at various levels of 
image resolution. Data are multicast 
among the computers on the basis of the 
data structure, such that by means of the 
multicast data and a provision for dy- 
namic selection among the computa- 
tional models, the same images can be dis- 
played on all the computers. For example, 
all users can observe a simulated surgical 
cut performed by one of the users. Thus, 
surgeons at multiple locations can collab- 
orate in planning complicated surgery in 
advance, using realistic displays. 

This work was done by Muriel D. Ross, Ian 
A. Twombly, and Steven Senger of Ames 
Research Center. 

Inquiries concerning rights for the commercial 
use of this invention should be addressed to the 
Patent Counsel, Ames Research Center, (650) 
604-5104. Refer to ARG14441. 



This Interactive Medical-Imaging System can be implemented in hardware and/or software. 
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